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ABSTRACT 

A quantitative synthesis of research findings on the 
effects of three major activity-based elementary science programs 
developed with National Science Foundation support was conducted. 
Controlled evaluation studies of the Elementary Science Study (ESS), 
Science-A Process Approach (SAPA), or The Science Curriculum 
Improvement Study (SCIS) were used to examine effects on student 
outcomes and effects oh classroom practices. For the effects on 
student outcomes, a meta-analysis of 57 studies resulted in 400 
separate comparisons involving 13,000 students from 1,000 classrooms. 
An average improvement of 20 percentile units on science process 
tests for students in activity-based programs over those in other 
programs was found. This improvement was significantly greater for 
disadvantaged students and less for advantaged students. Effects on 
classroom practices were synthesized from 12 studies in which 
teaching practices were systematically observed during 1,800 science 
lessons presented ill" activity-based and non-activity-based 
classrooms. Results indicate that,, on the average, the use of student 
hands-on activities increased by nearly 10% in the classrooms of the 
new programs. Talk decreased by 9% and lecturing by 7%. (DC) 
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The Effects of Activity-Based Elementary Science 
Programs on Student Outcomes and Classroom Practices: 
A Meta-Analysis of Controlled Studies 

The purpose of this report is to present a quanti- 
tative synthesis of the research findings on the effects 
of three major activity-based elementary science programs 
developed with federal support during the recent curri- 
culum reform era. Two effects were examined in depth; 
the effects on student outcomes and the effects on class- 
room practices. For the effects on student outcomes, 
meta-analysis techniques described extensively by Glass, 
McG4w and Smith (1981) were used in integrating quanti- 
tatively the results reported for fifty-seven studies. 
Effects on classroom practices were synthesized from 
twelve studies carried out by investigators who employed 
systematic observation techniques in activity-based and 
non-activity-based classrooms. The mean percentage of 
time devoted to various types of events were compiled 
across studies. 

Activity-Based Elementary Science Programs 

The three activity-based programs selected for 
review, because of the relatively wide adaption by 
school districts, were ESS, the Elementary Science Study, 



developed by the Educational Development Center (formerly 
Educational Services Incorporated); SAPA, Science-A 
Process Approach, the development of which was directed 
by the Commission on Science Education of the American 
Association for the Advancement of Science (AAAS) ; and 
SCIS, the Science Curriculum Improvement Study developed 
at Lawrence Hall of Science at the University of California, 
Berkeley, under the direction of Robert Karplus. These ^ 
programs- share a common set of departures from the 
"traditional", commercially available programs prevalent ; 
in the schools of the 1960's and early 70 f s. Sxneroglio' 
and Honigman (1973) summarized the distinctive trait's of 
the new programs as follows. 

1. They have resulted from collective efforts 
of scientists, teachers, administrators, 
and developmental psychologists. 

2. They have been tested in the classroom, 
modified and re-tested. 

3. Psychological principles of cognitive 
growth and development have been used 
as guidelines. 

4. They are activity-oriented, reflecting 
direct psychomotor experiences. 

5. There are no texts for students, only 
teacher manuals and guidelines. 

6. They contain M kits" of materials for 
students. 

7. They provide in-service training for 
teachers. 



8. They are process-oriented. 

Beyond these common features each of the three 
programs is distinct in the relative stress placed on 
science process and content objectives, the degree of 
program structure, and the advocated instructional 
approach. 

The Elementary Science Study (ESS), of the three 
major activity-based programs, is the least structured. 
The lack of prespecif ied, sequenced objectives and \ 
fof detailed instructional procedures was defended by one 
of the project directors, Walcott (1965), on the grounds 
that: 

...there is too much diversity in children, in 
schools, 1 and in teachers. The goals x>f" science 
education can be attained in^many ways; students 
can travel many different roads and reach many 
destinations. It would seem more important to 
let tlxem go in a direction they choose than either 
to lead^or^push them down a predetermined path, 
however worxhwtiile it may be (p. 1). 



The program is organised into fifty-six independent 
units with no fixed sequence acr^s^t.he elementary grades. 
Life and physical science units are i^cl^uded as well as 
several units involving activities; in spatia^relations, 
logic and perception. Activities are included bdth for 
their motivating quality and the opportunity they provide 
for problem solving and understanding of natural phenomena. 
Activities are often started with a challenge, problem or 
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perplexing event, followed by a period of open ended 
exploration /and concluded with a class discussion. Eval- 
uation is usually accomplished informally, through observ- 
ing children during instructional activities or examining 
their work. 

The Science-A Process Approach (SAPA) program is a highly 

structured program developed to teach specific science 

processes. The argument presented by Gagne (1963), a 

principle architect of the program, contrasts sharply 

with the defenders of ESS: 

...if transferable intellectual processes are 
to be developed in the child for application 
to continued learning in sciences, these 
must be separately identified, learned, and 
otherwise nutured in a systematic manner — 
one must learn to carry out critical and 
disciplined thinking in connection with each 
of the processes of science, (p. 53). 

The program is organized around eight basic and 

six advanced science processes. Each of the processes 

is broken down further into small steps for instructional 

purposes. All of these steps are expressed in behavioral 

terms and sequenced in a hierarchical arrangement. The 

content, on which the processes are practiced is drawn 

from both the life and physical sciences and is selected 

primarily because it presents a clear situation in which 

the process step being taught can be applied. Because 

of the sequenced nature of the objectives, evaluation at 
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each step is provided, to be used with individual students 
or with the whole class. 

The Science Curriculum Improvement Study (SCIS) , 
has as its primary goal the development of scientific 
literacy, defined by the program director, Karplus (1972), 
as a "combination of basic knowledge concerning the 
natural environment, investigative ability ... and curiosity.- 
The program consists of twelve units, one life and one 
physical science unit at each elementary grade level. The 
units stress what the authors believe to be major funda- 
mental concepts such as object , system , interaction ; 
energy source and receiver , organism , population , community 
and ecosystem . Approximately ten major concepts are 
developed each year. The concepts are interrelated and 
are intended to provide a conceptual framework for the 
childte thinking. The program is based on the assumption 
as expressed by Karpius and Thier (1966) that "...children 
must be led to form a conceptual framework that permits 
them to perceive phenomena in a more meaningful way and 
to integrate their inferences into generalizations of 
greater value than they would form if left to their own 
devices (p. 1)." Opportunity is provided for developing 
science processes as well. The general instructional 
pattern is to allow for free exploration of new materials, 
to introduce or "invent" a new concept, and then to allow 



the new concept to be applied in a range of new situa- 
tions. Evaluation is accomplished through observation 
during activities and through examination of work in 
student manuals. 

Meta Analysis of Effects of Activity-Based Programs on 
Learning Outcomes 

Although there were extensive formative evaluation 
procedures carried out during the development phase of 
each of the projects, there have been no nationally 
coordinated evaluation efforts to assess the effects of 
the activity-based programs on children in school districts 
adopting the programs. Fortunuately during the past 
decade a number of independently conceived evaluation 
studies have accumulated. Since most of this work has 
been reported in the form of doctoral dissertations, 
and unpublished, it has received little attention from 
the audiences which might benefit from the information. 

th (1969) and Gallagher (1972) presented early narra- 
tive reviews and more recently Welch (1979) reported on 
a qualitative summary of evaluation results of some of 
the studies on activity-based programs. The present 
analysis is intended to be an up to date, comprehensive, 
quantitative svnthesis of all of the available research 
and evaluation work in this area. 
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Method 

Locating Studies 

The first step in the meta-analysis of outcomes 
was to locate every study available from standard library 
sources. Both a computer and hand search were made of 
Dissertation Abstracts International , the RIE and CUE 
indexes of the Educational Resources Information Center 
(ERIC) , and Education Index . Recent issues of the periodi- 
cals, Jo urnal of Research in Science Teaching and Science 
Education and all issues of The Annual Review o f Research 
In Science Education and the programs of the annual meetings 
of the National Association for Research in Sc ience Teaching 
were searched. Bibliographies produced by the three 
activity-based science projects and bibliographies of each 
located report were used to locate additional studies. 
Approximately one-hundred reports of effects on student 
outcomes were located. 

Two requirements for inclusion of a study in the quantitative 
synthesis reduced the number of studies to fifty seven. First, 
the study design had to include a control group and second, the 
report had to contain sufficient information to calculate effect 
size. In the hope of salvaging a few more studies, letters were 
sent to some authors requesting further information; no 
replies were received. The complete listing of studies, 
identified by author and grouped by particular activity-based 
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program and outcomes area investigated, is presented in 
Table 1. 

Of the 57 studies, 70% were originally reported as 
dissertations. More than 1000 classrooms and over 20,000 
students were involved in all studies. Fifty-eight per- 
cent of the investigators used more than ten classrooms. 
Many researchers capitalized on inservice or university 
based teacher training efforts in identifying teachers 
who were using the programs. Typically, the recently 
trained teachers were compared with teachers in the same 
school or neighboring schools where the program had not 
been adopted. Seventy-nine percent of the studies had 
static groups or non equivalent control group designs 
(Campbell and Stanley, 19 63) which are considered quasi- 
experimental designs because they do not include random 
assignment of subjects to treatments. Forty-eight per- 
cent of the investigators tested effects after more than 
one year of program use. 

Describing Study Features 

The studies being integrated varied considerably 
in ways which could potentially affect the reported results. 
Meta-analysis techniques include procedures for testing 
empirically, whether or not study features have an effect. 
However, these tests require that study features be coded 
and treated quantitatively in the analysis. A preliminary 
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Outcorae Area 








Studied 


EES 


SAPA 
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Selene* Prw*s* 


Bartadale 73 


Beard 70 


Allen 67, 70, 72, 73a, 








73b 




Mansfield 78 


BreiSderraan 74 


Hillings 76 




Scfanodepoan 6^ 


Bullock 72 


Bowyer 78 






ClMjTiiiiaan 70 


Linn & Peterson 73 






Jactaiick 75 


Linn & Thier 75 






Judge 75 


Linn 72 






McClathery 67 


Maxwell 74 






Partin 67 


Riley 72 






Ranscrc 68 


Weber 71 








Kriaht 76 






75* 








Kideen 75 






Rldi^Y?rtT 74 


Davis, Raymond, 


Billings 76 




Onith 72 










Jordan 76 








Jadcnick 75 


Bowyer 78 






Norvinskv 74 


Linn 72 






Partin 67 


Long 73 






Raven & Calverv 77 


Riley 72 






onith 72 


Snith 72 






Veidovic 73 








Kideen 75 




Affect 


Barksdale 73 


Jacknick 75 


Alien 72, Jib 






Kol**K*c: 71 


Brown 73 






Novinsky 74 


Hofman 73 






Partin 67 


Krockover & Malcolm 77 






" Kideen 75 


Linn & Thier 75 








Lowry 79 








Malcolm 75 








Riley 72 








Kriaht 76 




Fick 74 


Davis, Raymond, 


Brown 73 


Wimslv*nj&r 76 


MacRawls & 








Jordan 76 








Novinskv 74 








Ransom 68 




Language 




lyprfi & Mason 69 


Coffia 71 


aft! Mufl 

jjevejuoppenu 




n» xri c Pavmnnd. 


Heath 70 




MacRavls & 


Kellogg 71 






Jordan 76 


Mansfield 78 






Stuff 73 


Maxwell 74 






Kolebas 71 








Raven & Calvey 77 








Yow 75 




Mathematics 




Ayers i Mason 69 


Coffia 71 






i>vis. Ravimnd- 


Kellogg 71 






MacRawls & 


Maxwell 74 






Jordan 76 








Kolebas 71 








Raven & Calvey 77 




Perceptual 




Ayers & Mason 69 


Battaglini 71 


Development 




McClathery 67 


Kellogg 71 






Maxwell 74 ' 


Logical 


Labincwich 70 


Bredderman 74 


Bowyer 78 


Development 




Cleminson 70 


Hansen 73 




Howe & Butts 70 


Linn 72 






Raven & Calvey 77 


Lorn 73 


Intelligence 




Johnson 70 


Stafford 69 




Kolebas 71 
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reading of the identified studies in the present analysis 
led to the defining of fifteen study features which were 
described with sufficient frequency to warrant their j 
inclusion in the coding system. The variables, their 
values, and the number of studies coded for each value 
are presented in Table 2. Five variables define method- 
ological features; three define treatment conditions; 
three, student characteristics; two, publication features 
and one variable defines learning outcomes of studies. 
The variable names and the definitions of their values are 

as follows: 

Methodological Features 

Random assignment of student s to comparison groups. Was 
a random or matched pairs technique used to assign students 
to activity-based and non-activity-based groups as opposed 
to using intact classes? 

Control of instructor effect . Did the same instructor 
teach both experimental and control groups? 

Form of test administration . Was the outcome instru- 
ment administered in paper and pencil form to the whole 
class or was another form of test administration used such 
as using audio-visual or manipulative materials with small 
groups or in individual interviews? 

Test source and standardization . Was a commercially 
available, nationally standardized test employed as opposed 
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/Table 2 

Number of Studies for Coded Variable Categories 



46 
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Coded Variables and Categories Number of Studies 

Methodological Features: 

Random Assignment of Comparison Groups 
(1) No 
<2> Yes 
Control of Instructor Effect 

(1) Same instructor for both groups 8 

(2) Different instructor/volunteers 11 

(3) Different instructor/random or mandated 39 
Form of Test Administration 

(1) Paper and pencil with whole class 26 

(2) Audio-Visual with whole class 16 

(3) AV or manipulatives with small group 7 

(4) Manipulatives with individuals 18 
Test Source/Standardization 

(1) Investigator develop 30 

(2) Limited standardization I 7 

(3) Commercial-nationally standardized 22 
Sample Size 

(1) Ten or fewer classes ' • 

(2) More than ten classes 

Treatment Conditions: 

Activity-based science program 

(1) ESS (Elementary Science Study) 9 

(2) SAPA (Science A Process Approach) 22 

(3) SCIS (Science Curriculum Improvement Study) 28 
Control Group Treatment 

(1) Teacher autonomous or undefined 29 

(2) Science text 26 

(3) Laboratory program or Lab- text program 8 
Duration of Treatment 

(1) One year or less 

(2) More than one year 
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20 



Student Characteristics: 
Grade Level 

(1) Kindergarten through third grade, K-3 27 

(2) Fourth through sixth grade, 4-6 35 
Advantaged Status 

(1) * Handicapped: physically, mentally retarded 

(2) Disadvantaged: inner city, rural, low ability 14 

(3) Average: cross-section, average ability 3 4 

(4) Advantaged: suburban, high ability gifted 16 
Gender 

(1) Male " 

(2) Female 11 

Publication Features: 
Source of report 

(1) Unpublished report or dissertation 34 

(2) Published dissertation or report 23 
Ye*r of publication report 

(1) 1967-69 J 

(2) 1970-72 L " 
*~X3) 1973-75 7t 

(4) 1976-78 |° 

(5) 1979-81 1 
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to an experimenter developed test or test of limited 
previous use? 

Test bias . Did the test match the objectives or 
teaching activities of one of the two treatments being 
compared more than the other? Test or test descriptions 
and program activities were examined in making this 
judgement. Each test was rated twice, several months 
apart, by this author. 0 There was over 95 percent agree- 
ment between the two ratings. 

Sample size . Were a total of ten or more classes 
used in the study? 

Treatment Conditions 

Activity-based science program . Which of the activity- 
based programs, ESS, SAPA or SCIS was being compared with a 

control group? 

Control group treatment . What was the nature of the 
science program being experienced by the control or compar- 
ison group? Was the program a "teacher autonomous program" 
in that there was no indication in the report that a commer- 
cially available program was being used or in that it was 
indicated specifically that the program was locally developed 
Was it specifically stated that a commercially available 
"text ,: program was used? Was it specifically stated that 
a "lab-text" combination or a laboratory program other 
than ESS, SAPA or SCIS was used? 
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Duration of treatment . Haw long were the students 
involved with the program before final outcome tests 
were administered; one year or less, or more than one year? 

Student Characteristics 

Grade level . Were the students, at the time when outcomes 
were measured, in kindergarten through third grade or 
fourth through sixth grade? 

Advantaged status . Were students handicapped, 
disadvantaged in other ways, average, or advantaged? 
Handicapped included students with physical handicapping 
conditions and educationally mentally retarded (EMR) . . 
Disadvantaged students included those described as inner 
city, rural, low socio-economic status, or low ability 
or intelligence. Average students were those who did not 
meet the conditions for either advantaged or disadvantaged 
students. Advantaged students were those described as 
suburban, high socio-economic-status, high ability, or 
gifted. 

Gender . Because only eleven investigators reported 
results separately for male and female students, this 
data was coded and analyzed separately. 

Publication Features 

Publication statu s. Was the report ever published? 
Year of publication . When was the study published 
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or if * not published, what was the date of the report? 
Outcome Area 

Science process . Any study in which the outcome for 
a majority of test items required the student to handle natural 
science content by doing any of the following: analyzing, 
predicting, manipulating variables, problem solving, infer- 
ring, explaining from data, identifying variables, describ- 
ing change and interaction based on observations, measur- 
ing, contructing histograms, observing properties and 
reporting on them? 

Science content . Any study in which the outcome 
measure was a subtest of a coitu..ercially available standard- 
ized achievement test in which students were required to 
identify or respond with facts, concepts or principles 
relating to the natural world. 

Creativity . Any study in which a test was described 
specifically as a test of creativity. 

Language . Any study in which a test was described 
as measuring reading readiness, word meaning, vocabulary, 
comprehension, listening, expression or language arts 
abilities . 

Mathematics . Any study in which a test was described 
as measuring mathematical computation, concepts, application, 
or readiness. 
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Perception . Studies in which perception tests were 
used, including non-spatial, spatial, figural, language 
and non- language tests. 

Lo gical development . Studies using tests of Piagetian 
logical operations such as classification or seriation of 
generic content, conservation, conceptual logic, or combina 
torial logic. 

Affect . Studies using instruments described as measur- 
ing anxiety, attitude, satisfaction, appreciation, enjoy- 
ment, interest, motivation, exploratory motivation, curio- 
sity, critical perception of learning environments and of 
amount learned. 
Coding Unit 

Because researchers compared groups on more than 
one outcome or reported comparisons for particular student 
subgroups separately, every reported comparison between 
activity-based and non-activity-based group was coded as a 
single case. For the fifty-seven studies a total of 400, 

comparisons were coded. Coding comparisons separately 

i 

permitted aggregating comparisons from studies with common 
features and, by using weighting procedures, giving all 
studies equal weight in any sub-analyses . Weighting 
studies equally avoids the problem of potential inter- 
dependencies among the several comparisons which may have 
been coded for a single study. 
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Defining Dependent. Measures 

Three alternative indicators of activity-based 
science program effects were determined, whenever possible, 

1 

? * 

for each comparison 1 . First, the reported significance 

level an( a direction of effects were coded on an eight 

2 

point scale. Second, the strength of the effect, w , 
was recorded either as reported or calculated from t or 
F values. Third, effect sizes were calculated as suggested 
by Glass (1978); from means and control group standard 
deviations and from t and 'F values. Whenever possible, 
reported, unadjusted means were used or recalculated from 
ANCOVA data. When percentages of students passing 
specified cutoff scores were reported for activity-based 
and control groups, differences of standard normal deviates 
(z f s), obtained from a table or normal curve values were 
used in calculating effect sizes. 

Results 

The overall effects of the activity-based programs 
on all outcome areas combined was clearly positive, although 
not dramatically so. Thirty-two percent of all 400 compari- 
sons favored the activity-based program group and were 
reported as statistically significant at, at least, the 
.05 level. Only six percent favored the non-activity based 
program group at the .05 level of significance. These 
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results support rejection of the hypothesis of no effects 
since, if there were no effects, equal percentages of 
significant results favoring experimental and control 
groups would be expected. 

Calculations of the percent of variance in outcomes 

2 

accounted for by .program differences (itf ) indicate that 

for all outcomes combined, on J the average, five percent 

of variance was accounted for. If only process outcome 

• results were considered, on the average, the percentage 

of variance accounted for was ten percent. Welch (1979), 

based on his experience with The Harvard Project Physics 

evaluation concluded that: 

- curriculum does not seem to have much impact 
on student learning no matter what curriculum 
variations are used... We at Project Physics 
eventually concluded that 5% (of variance) 
was an acceptable return on our investment 
since we could seldom find greater curriculum 
impact on the students ... Changing 40% of the 
content in a variable that only accounts for 
- 5% of the variance in the first place is not 
likely to produce dramatic effects (p. 301) . 

Many factors other than the program being used, such 
as student ability, time on task and teTacher ability must 
have played a major role in how well students did on the 
tests used in these studies. 

The mean effect size for all studies,, weighted equally, 
on all. outcomes was .35. This can be described as a small 
to moderate effect size (Cohen, 1977). It indicates about 
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a 14 percentile improvement for the average student as a 
result of being in the activity-based program group. 
Because of the variety of outcome areas tested and the 
influence of the relative number of studies for each 
on the mean effect size, it is important to examine the 
effects on each outcome area separately. The mean effect 
sizes of various outcome areas were somewhat different. 
The results are shown in Figure 1. The effects on measures 
of process and creativity can be considered moderate 
(ES = .52, ES = .42 respectively) and on all other outcome 
areas, small, although positive (from ES = .12 to ES = .27) 
We can be fairly certain that the use of activity-based 
programs relate positively to student' achievement in these 
outcome areas with the one exception of effects on logical 
development. In all but this case the 95 percent confi- 
dence intervals around the population means do not include 

zero effect size. 

One of the often heard reactions to the activity- 
based programs has been that they put too much stress on 
science process at the expense of content learning (Atkin, 
1966; Ausubel, 1963; Labalm, 1966; Fishier, 1965). Victdr 
and Learner (1971) expressed the view that: 

This enthusiasm about the process approach to 
learning science has become so great that the 
pendulum is swinging the other way, and process 
is beginning to be emphasized at the expense of 
content. Some of the new programs are paying 
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Figurel Effect sizes for studies of activity-based elementary science programs 
grouped by outcome areas. 



little attention to learning concepts. The 
science content in the program is almost 
completely unstructured, and whatever content 
that is included is used only as a means of 
getting the child to learn process (p. 317). 

At least when activity-based programs are compared 
with traditional science programs on standardized achieve- 
ment tests of science content these fears appear to have 
been unwarranted. Content achievement was not seriously 
affected in a negative way even if the subgroup of 
studies, which contrasted activity-based programs with 
text programs, was considered (ES = .02 for 9 studies). 
Several investigators, have contrasted the teaching of 
science content using particular aspects of activity-based 
approaches, with more traditional methods, outside of the 
context of specific science programs. They have generally 
found that the activity-based methods produced greater 
science content learning (Davis, 1978; Marlins, 1973; 
Voelker, 1975; Vongchusiri, 1974). 

The mean effect sizes for affective outcomes are 
generally small (ES = .28 for 15 studies) but consistent 
with those reported for other meta-analyses of innovative 
classroom practices. Peterson (1978) reported a mean effect 
size of .14 favoring open classrooms for seven affective 
outcome areas. Kulik, Kulik and Cohen (1980) reported a 
mean effect size of .24 on attitudinal measures favoring 
computer assisted instruction (CAI) over conventional 
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methods and a mean effect size of .18 for attitudes 
toward the subject matter in CAI over conventional classes. 
In the present analysis the mean effect sizes for various 
types of affective measures did not differ significantly. 
The size of effects which innovative methods can have on 
affective outcomes, in general, appears to be confined to 
a narrow range. 

The small positive effects on language outcomes (ES = • 
.23 for 11 studies) are attributable in large part to 
comparisons in a few studies of language expression at the 
early elementary grades (ES = .52 for 14 comparisons). 
Effects of comparisons for other language related outcomes 
are much smaller (Reading; ES = .10 for 40 comparisons; 
listening, ES = .20 for 5 comparisons). 

The expectation that the activity-based programs, 
with their problem solving orientation and provision 
for some free exploration, should lead to increased 
creativity is a reasonable one. Five investigators 
measured this outcome. Four of the five studies were 
done at the intermediate grade levels. The results 
generally confirm the expectation (ES = .42 for five 
studies) of positive effects. It is interesting that 
Peterson (1979) reported a positive, though smaller, effect 
size (ES = .18) for open over traditional classrooms 
based on eleven studies. 
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Study Features and Effect Sizes 

In this section the results of zero order correla- 
tional analysis and multiple regression analyses of 
study features and effect sizes are reported. Then, the 
mean effect sizes for studies grouped by various study 
features are examined in detail with emphasis on those 
features most strongly related to effect sizes in the 
correlational analyses . 
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Correlation Analysis . Zero order correlations between 
each of the study feature variables and effect sizes were 
determined with each study given a weight of one. See 
Table 3. Two variables had significant correlations with 
effect size; student advantaged status (r=.25, d.f.=55, p=.03) 
and the rated bias of the outcome test (r=.22, d.f.=55, p=.05). 
These correlations indicate that higher effect sizes were 
obtained in studies of disadvantaged students and in studies 
in which outcome measures were judged to be biased toward 
the activity-based program. The mean effect size reported 
when disadvantaged student groups were compared was -65; 
those for groups classed as average or advantaged were . 30 
and .22 respectively. The mean effect size for studies 
in which outcome measures were judged to be biased toward 
the activity-based program was .54; that for unbiased mea- 
sures was .24 and for measures biased toward the control 
group, .13 ' (see Figure 2a). 

Multiple Regression Analysis . As would be expected 
from the generally low zero order correlations, linear 
combinations of study feature variables were not strong 
predictors of effect size. Each of the multiple regression 
analyses reported on here included the use of a weighting 
factor for multiple comparisons within studies so that each 
study contributed one degree of freedom to the analysis. 
When a step wise multiple regression analysis was carried 
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Figure 2a. Effect Sizes for studies of activity-based elementary science programs. 
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out on the set of variables for^ which zero order correlations 
were reported, advantaged status and test bias variables 
accounted for 8.7% of the variance in effect size. With 
a new variable defined as process outcome (versus non- 
process outcome) was substituted for test bias in the vari- 
able set, the advantaged status and process outcome variables 
accounted for 9% of the variance in effect size. Neither 
of these or other multiple regression analyses which were 
carried out. yielded statistically significant (p<.05) F values, 
indicating that it is not possible to reject the hypothesis 
that the population multiple R for combinations of study 
features and effect size is zero. Study features examined 
in this meta-analysis do not provide a strong basis on which 
to predict measured effects. 



Table 3 



Correlations of Study Features with Effect Size, 
Each Study Given Equal Weight, N=56 



Feature 



Correlation 
with 

Effect Size 



Methodological n . 
Random Assignment (l=no, 2=yes) - u - 
Control of Instructor Effect (l=same instructor, 

'2=different instructor) ""*?? 
Form of Test (l=paper and pencil, 2=other) .13 
Test Standardized (l=national standardization/ 

commercial, 2=other) * 08 
Test Bias (l=not biased toward activity-based 

program, 2=biased) 
Sam.Dle Size 



Publication Status (l=un?ublished , 2=published) 
Year of publication 



* o < .05 
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04 

Treatment Duration (1=< one year, 2= < one year) .01 

Student Characteristics _ 

Grade Level (l=K-3, 2=4-6) ~" * 
Advantaged Status (l=average and advantaged, 

2=dis advantaged) m rz 

Gender (l=male, 2=feroale) "'(N=22) 

Publication Features 

_ -j. -o-,,^ n=,mrMiKi cVipfl. 2=nublished) .16 



.09 
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Student Characteristics and Effect Sizes 

The three characteristics of students which were 
examined were advantaged status, grade level and' gender. 
The effect sizes for each of the three variables is 
displayed by study in Figure 2. 

The mean effect size for studies involving students 
in the primary grades was almost identical with those involving 
intermediate grade students (ES - .35 and ES - .34 respec- 
tively) . 

Studies of disadvantaged students had a 'mean effect 
size of .65 and those of average and advantaged students 
were .30 and .22 respectively. Neither of these latter 
two are within the 95 percent confidence interval of the 
mean effect size of studies of disadvantaged students. 
A greater mean effect size for disadvantaged students 
was found for all major outcome areas except the affective 
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outcomes. Tn this case there was no difference between 
disadvantaged and other student categories. The effect 
sizes for science process and science content outcomes 
for each of the advantaged status categories are presented 
in Figure 3. Based on nine studies, disadvantaged students 
in activity-based classrooms outperformed those in non- 
activity-based classrooms by a full standard deviation on 
measures of science process. The mean effect size of 
studies of disadvantaged students on science content out- 
comes was .52 and those of average and advantaged students 
were .02 and -.10, respectively. The activity-based pro- 
grams appear to help only disadvantaged students with 
regard to science content. 

There is some evidence that the activity-based 
programs may have different effects on males and females. 
For most outcome areas there were no differences in mean 
effect sizes. However, in the three outcome areas, 
language development, mathematics, and perception where 
there were any noticeable differences, the effects were 
always greater for males. Since there were a total of 
only six. studies in which these three outcomes were 
examined, the results should be viewed cautiously. If 
anything, males may benefit more from activity-based 
science. But, if so, the added benefit is in areas other 
than science process or content. 
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The three treatment features; (1) treatment duration; 
(2) specific activity-based program; and (3) the type 
of treatment received by the control group, failed to 
be' significantly related to effect size in the correlational 
analysis* However, some tendencies emerged based on small 
numbers of studies when these study features were examined 
for effects on specific outcomes* Mean effect sizes for 
the features, for all outcomes combined are reported in 
Figure 4. 

No influence of duration of treatment on effect sizes 
were evident for any outcome areas. The lack of increasing 
effect sizes with length of treatment suggests that the 
advantages derived initially from the activity-based exper- 
ience are maintained but not compounded over time. Whether 
this advantage is maintained if the program is discontinued 
is open to speculation. Three investigators examined 
former students of the elementary activity-based science 
programs in the years after elementary school. Bredderman 
(1974) examined effects on logical development and science 
process outcomes in 8th and 10th grade. Wright (1976) „ 
measured effects on attitudes and process outcomes in 
7th grade. Raven (19 77) investigated science content and logical 
and language growth of 8th grade students. The mean effect 
size of the thirteen comparisons in the three studies was 
zero. Eight comparisons were negative and only one (Rsven's 
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Figure 4 Effect sizes of studies of the effects of activ/ity-based programs for all outcomes 
grouped by treatment features. 
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Table 4 

'* Effects of Elementary School Activity-Based Programs 


Beyond Elementary School 


* 


Outcome Areas 


Author Proqram Grade Level(s) Process Content 


Affect . ■ Loqic Hath - 


lanauaqe 


Bredderman SAPA 8, 10 -.12.. 14 
1974 (.01)* 


-.50, .24 
(-13) 




Wright SCIS 7 -.19 
1976 


-r.41 




Raven&Calv/eySAPA 8 -» 01 

1Q77 


.21,1.19 .06 
' (.70) 


-.06, -.05, -.11 
(-.07) 


Mean -.° 9 -- 01 
Weighted grand means= -.005 


-.41 .29 .06 


-.07 


^Numbers in parentheses are mean effect sizes for the outcome of the study. 
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test of logic) was above .25. There is no evidence in 
these studies to indicate that the advantage gained and 
maintained during the years of activity-based science 
program use are sustained in the years following the program. 
The effect sizes of all comparisons testing retention 
beyond elementary school are shown in Table 4. 

If effect-sizes on all outcomes are combined, there 
appears to be no major differences among the three 
activity-based programs, ESS, SAPA, and SCIS. But, when 
science process and content outcomes are examined separately, - 
the relative emphases of the programs is evident. The 
effect sizes for these two outcome areas are reported for 
each of the programs in Figure 5. The highest mean effect 
sizes on process outcomes were reported for SAPA, 
(ES = .71) and SCIS (ES = .43). SCIS studies had slightly 
higher effect sizes on science content outcomes. However, 
this slight edge is derived from two studies in particular 
(Linn and Peterson, 1973; and Linn, 1972) which had the 
highest effect sizes. The two measures on which these 
effect sizes were obtained were both judged to be biased 
toward SCIS in science content on the test bias variable. 
SCIS also produced greater mean effect sizes on measures of 
logical development. Again, the tests used to assess the 
outcome in two studies with especially high effect sizes (Long, 
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FIGURE 5 Effect sizes of various studies of the effects of activity-based programs on 

science process and content outcomes grouped by specific activity-based programs. 
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1973; Bower, 1975) were rated as biased toward the 
activity-based program. 

The importance of the match between what the 
activity-based programs stress as curricular outcomes 
and that which is measured in any evaluation of effects 
was clear from the earlier analysis. More positive 
effects were found for activity-based programs when the 
outcomes measured were those emphasized by these programs 
• ] rather than by non-activity-based programs. The compari- 
son of effects among the activity-based programs provides 
evidence 1 of relative program emphasis. SAPA, a program 
designed to teach science process, more so than the other 
programs, results in the greatest effect on process out- 
comes. The use of SCIS, which puts more emphasis on 
content, leads to higher science content effect sizes, 
especially if the outcome measures emphasize the parti- 
cular content stressed within the SCIS program. 

There was a tendency for effect sizes to be smaller 
for studies in which any of the three activity-based pro- 
grams was compared with a laboratory-text combination 
program or a laboratory-non-text program (see Figure 5a) . This finding 
would be expected under the assumption that the positive 
effects of the activity-based programs were derived 
from the laboratory activity aspects of these programs. 
The effect sizes are especially lower for science process 
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FIGURE 5b Effect sizes of studies of effects of activity-based programs on science content 
outcomes grouped by comparison group treatments. 
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and logical development outcome areas. There was a 
tendency for effect sizes to be near zero for science 
content outcomes when comparison groups were reported 
to be using textbook programs, Figure 5d< This result is consis 
tent with the view that in text programs a more deliberate 
effort is made to teach science content than with the 
activity-based programs. If anything, such a view, 
leads to the expectation that effect sizes would be 
negative for studies in which content achievement compari- 
sons are made. That they were not, raises the question 
of how students in activity-based programs, without texts, 
acquire the traditional science content to the same extent 
as students in the text programs. Karplus (1964) contended 
that lack of relevance and attention to the development of 
the child may be the sources of ineffectiveness of tradi- 
tional programs. 

Instead of guiding this development in the 
direction of modern scientific understanding — 
the present day science courses create a 
second, separate, relatively abstract struc- 
ture which is not used outside the school 
situation and which eventually atrophies. 

The mean effect sizes for studies grouped by each 
of the methodological variables are shown in Figure 6 . 
These data indicate that investigators who used nationally 
standardized tests, in paper and pencil, group administra- 
tions, and who used tests which were not biased toward 
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Figure 6 . Kean Effect S/izes Eased on at Least Three Studies for 
Various METHODOLOGICAL FEATURES 
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the activity-based program tended to report lower effect 
sizes. These particular features are those which were 
found relatively infrequently in studies of science pro- 
cess outcomes. Table 5 shows the number of studies with 
these features and measures of process and content out- 
comes. The uneven distribution of studies between the 
two outcome areas indicates that the tendency for effect 
sizes to vary with these three study features may be a 
consequence of stronger effects of the activity-based 
programs on process as opposed to other outcome areas. 
If this is assumed to be true, it is likely that the 
methodological features may account, directly, for little 
if any of the variation in effects. The lack of suffi- 
cient studies with certain methodological features, and 
which included the measurement of science process, makes 
the confounding of the effects of method and outcomes 
unresolvable. However, the general finding of a lack of 
direct influence of methodological qualities on effect 
size would not be unusual (Glass, McGaw and Smith, 1981, 
p. 224-225). 

The effect sizes for the two publication features, 
year of publication and whether or not the report was 
published, are shown in Figure 7 . Studies were reported 
between 1967 and 1980- There was no pattern of variation 
in effect sizes associated with year of publication or 



Table 5 

Numbers of Studies with Selected Methodological Features and 
Pleasures of Science Process and Content Outcomes. 

Methodological Feature Outcomes — — 

' Process Lontent 

Instrument Used 

Not nationally standardized 28 ( 
Nationally standardized 0 7 

Instrument Administration 

Paper and pencil/Group 5 
Non paper and pencil! 24 
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Favoring Activity-Based 
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Figure 7 Effect sizes of studies of the effects of activity-based programs for all outcomes grouped by 
publication features. 
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reporting. However, published reports had almost double 
the mean effect size (ES = .48) of unpublished reports 
(ES = .25). Glass, McGaw and Smith (1981, p. 226) report 
a 33% inflation of published over non-published effect 
sizes, based on a summary of nine meta-analyses. 
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The Effects of Activity-Based Probrams on Classroom Practices 



Developers of the activity-based programs, in order to 
alter what was to be learned, set out to change the nature of 
elementary science classroom experiences of children. Simply 
stated, if children were to learn the investigative nature . 
of science, they would have to become involved in inves- 
tigations. The primary data source for the thought pro- 
cesses would have to be the objects of nature and the 
interactions of the child with those objects. The teachers 
role would shift from one who assigned text readings, 
conducted discussions on the readings and gave demonstra- 
tions, to one who organized students 'into investigative 
groups, managed laboratory materials, posed "thought 
questions and helped students generally to ask research- 
able questions, and to gather and interpret data. 

To answer the question of whether or not activity- 
based programs, when implemented, actually accomplished 
these changes in classroom practices, the literature was 
searched for all available studies which involved com- 
parisons, based on systematic classroom observations, 
between traditional programs for teaching elementary 
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science and the three major activity-based programs, ESS, 
SAPA, and SCIS. Through searches of ERIC, CUE, Education 
Index, Dissertation Abstracts International , current issues 
of the Journal of Research in Science Teaching and biblio- 
graphies of all reports identified from these sources, 
twelve studies were located. In general the studies fell 
into two categories, those which" included a system for 
recording a spectrum of teacher and student verbal behavior, 
such as the Flanders Interaction Analysis Category System 
(FIAC) , and those which looked at only the type of questions 
which were asked by teachers. In all but one case (Gates, 
1976) the data was gathered during the first year of the 
teacher's use of the program. Features of each of the 
studies are presented in Table 6 ,. A total of 467 teachers 
were involved in all of the studies. Approximately 1800 
science class sessions were observed and coded by all 
investigators. Six investigators observed SCIS classrooms, 
five observed SAPA classrooms and one observed ESS class- 
rooms. Eight included some primary grade classrooms in 
their sample and four included intermediate level class- 
rooms. Two did not report the grade levels involved. In 
addition to contrasting activity-based with non-activity- 
based programs, several of the investigators contrasted 
the effects of inservice and summer training or the effects 
of consultant follow up help with the absence of these 
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Analysis 

Based on a preliminary read: 
composite category system of classroom practices was 

developed which would allow a test of whether or not the 

j 

shifts in classrooms practices intended for activity- 

I 

based programs had occured. Thk composite categories 
and their definitions are presented in Table 7. For 
each category the percentage of class time devoted to 
the category was tabulated. Since in general there 
was a shift away from the percentage of time reported 
for talk on the part of both teachers and students in 
activity-based classrooms, it was decided that percentages 
of total class time devoted to each practice obscurred 
shifts within subcategories. Thus it was possible, for 
example, for the absolute time spent on high level ques- 
tioning to decrease although there was a shift from low 
level to high level questioning. To over come possi- 
bilities of this type, percentages of time devoted to 
smaller categories were determined relative to only the 
immediately larger category. Thus, for example, percentages 
of total questioning time devoted to low and high level question- 
ing were calculated to see if a shift had occured from 
one type of questioning to the other. The intended 



Table 7 



Composite Classroom Behavior Categories as Defined 
by Various Investigators 



Student Activity 

overt activity (Hall 70), pupil experimentation (Korine 71), 
silence or confusion category of FIAC (Harty 76, Newport 70) 
student problem activity (Westmeyer 1967). 

Student Initiated' Talk 

student answers with opinion or concept or student 

comments in response to nondirective question (Fishier 65), 

student comment" or student question (Horine 71) 

student open, evaluative or divergent statement (Hall 70) 

pupil initiated talk to teacher (Harty 76) 

student initiated student talk (Newport 70) 

student question or student initiated idea (Westmeyer 67). 



Student Responsive Talk 

student answers with a statement of fact or comments 
in response to directive question (Fishier 65) , 
student closed statement, memorative, cognitive, or 
converaent (Hall 70), pupil response to teacher talk (harty 
76, 71), student response (Horine 71, Westmeyer 67), 
teacher initiated student talk (Newport 70). 

Lower Level Teacher Question 

asks for, recognition, recall, demonstration of skill, 
comprehension (Bruce 69, Porterfield 69, Wilson 69) asks 
for, routine, cognitive memory, or convergent response, 
(Eaton 74), asks closed, memorative or convergent question 
(Hall 70), asks recall of facts, relationships, or to 
make observation (Fishier 65, Moon 71). 



Higher Level Teacher Question 

asks for analysis, synthesis (Bruce 69, Porterfield 69, 
Wilson 69), asks for divergent, evaluative response 
(Eaton 74), asks open divergent, evaluative question 
(Hall 70), asks to hypothesize or test hypothesis (Fishier 
65, Moon 71) . 

Teacher Instructive Talk 

teacher lectures or gives directions (Fishier 65, Horine 71), 



Table 7 continued 



aives new information or gives directions (Kail 70) , 
teacher lecture or information giving or giving direc 
tions (Karty 76 , Newport 70) , teacher lecture, explan 
tion or teacher direction (Westmeyer 67). 
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shifts in classroom practices as generally expressed 

in the literature for activity-based programs are depicted 

in Figure 8 for categories and subcategories. 

/ 

Findings 

The data and findings are shown in Table 8 and Figure 
9. All studies showed- a shift away from spending time on 
talk involving the whole class. The silence and verbal con- 
fusion category of FIAC was used in this analysis as the 
indicator of the shift away from talk when no specific 
student activity category was coded, as suggested by • 
Newport and McNeill (1970). There was approximately a 
ten percent average 'shift away from talk and toward student 
activity for the ten available comparisons made between 
activity-based and non-activity-based groups involving 
a total of 273 classrooms. In traditional classrooms 
roughly 80 percent of the time was devoted to talk of 
student and teacher. * In activity-based classrooms 
roughly 70 percent of the time was devoted to talk. 
This shift is in the intended direction, but probably 
less then the magnitude of shift one might expect from 
examining the teacher* s guides and other training materials 
produced by the program centers. 

The only other shift which was consistently reported 
was that of all teacher instructive talk, consisting of 
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FIGCRL 8 Expected shifts in classroom practices based on the instructional 

approached advocated for the activity-based elementary science programs 
and actual mean percent shifts (in parentheses) reported for controlled 
studies. 
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Table 8 

Percentage of tim* devoted to various classroo* practices by investigators of activity- based and non-activi ty-based elementary scionce classrooms. 

A_*-i;r eruce Eaton Fis hier Gates Hall Harty Horlne noon Neufiort Uostmoyer tftS 20 1*1*1* 

03te TTTr T774 USb 1*76 IS70 1V76 iy71 1971 197U 1^67 1569 

^r:::a^ SCi5 5C1S 5C15 tSS SAPA SAPA 5APA 5CI5 SAPR SAPA 5C 5 

C-s»rvat'cn T31 GAS FlACiSTOI FIAC 1A5T FIAC-Auqmented FIAC F1AC+ST01 F1AC FIAC-Augmented TQI 

l.v.l - 6.5.6 4.S.6 1-6 2 K.l.2 2,3,4 ptl..t, - 1,2,3, 2-6 g.J.^^V.ri,. 
C:-cosita Categories of Classroom Interaction Behavior and Percent of Time Reported for each Behavior 
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13,1 14,4 5. 5 20,3 17,4 11.7 48,5 15.0 20.2 12.1 11.0 17.1 16.7 14.1 6.5 J^TFTx* 9 * 5 

(10. 9 (3.9) 

74,4 72.2 80.3 75.5 82.0 84,6 -48.5 66.9 79.7 87.9 89.0 59.9 65.6 66.0 78.5 71 .2 79.9 -B. 7 

(11. 9( 0.3) 



Student 34.4 30.1 18.4 18.2 23.9 25.4 28.4 29.3 16, B 21.5 49.0 39.0 29. 4 23.1 24.6 18.9 21.7 19.5 28. 8 21.9^25.6^-3.7 



Til 



Teener • ^ 65.6 69.9 49.4 55.9 56.0 54.0 S6.4 50.1 53.6 55.3 31.7 45.4 47.7 47.2 5i.3 64.8 64,4 41,7 43.9 46.5 49.7 49. 4^ 54. 2^-4. B 



Student 25.9 19.2 0.1 0.4 1.6 10.6 7.4 12.4 4.2 7.1 13.1 5.1 .7.9 2.6 2.9 2.6 4.4 (J^M^of ^ 



Initiated 
TaU 

Stvcsnt B,4 10,9 

Tal- 



16,7 16,2 20,6 14,8 21,0 17,0 12*7 14,4 15,4 17,9 16,7 16,3 18,8 16,9 24,4 16, 7^ . 9 



Teac ^ 9r 16,1 19,4 16,3 15,2 16,2 20,0 20,3 16,9 11,1 14,0 17,4 23,1 20,1 15, 3 17,6 17,8 20,5 (3*3)(2*7) ° 

T M! hirM 45,2 25,0 18,1 7,9 5,8 7,0 0,3 0,5 1.2 ".4 7.6 33.1 10.3 ^2.2^4.1-1.9 

n; .ev/el y jf # .# * ?g#0 12 . 7 16.3 

Juest.cns (12.0)(B.3) 

TwO..— 54.8 75.0 81.9 92.1 10.3 12.4 16.0 14,B 15,0 80,6 92,4 66,9 89.6 {^13.7 0 

L:-.»,el # I # # W 7U0 87.3 16.3 

Cf, s (1?.6)(6.3) 

Tea _ gr 4O#0 41#Q 25#4 24#8 23-0 lg#6 2A , 7 30#4 12.7 21.0 19.0 17.7 22. S 29.0 31.5 21.0 20.7 23.7 23.7 22.4^25. 90.3 

Ir^tructive 



Tal> 

T92 -. 3r 6.4 5.6 9.9 11.4 4.3 4.9 B.7 6.1 1.6 2.0 7.1 8.1 5.3 11.9 10.3 13.2 7.9 (Slsxllg)* 3 ' 8 

Directions 

T9 , ef .„ 34.4 34.5 15.5 13.4 18.8 14.7 16.0 24.3 ll.l 19.0 IS. 5 20.8 26.2 9.1-10.4 10.5 15.8 13.^20.8^-7.1 

Ccrtfent 

* r,tt jCtUn » Treatwen t; A « Activity-based Group, N » Non-activity based Group, ST -Sumner Trained, IT-lnservice Trained, U-Untreined in Act! vity-8ased Science ~ 
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••Questioning Level: J indicates that the number of questions asked rether than the tine devoted to questions was reported by the investigator. 
Totals include only reported percentages of time. 
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Figure 9 Differences in practices observed in activity-based and non-activity-basea 
elementary science classrooms. 
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both science related statements and procedural statements, 
roughly fiften percent more time was devoted to giving 
procedural directions, and conversely, fifteen percent 
less to content related lecturing. The incrrase in the 
giving of directions was noted by several investigators 
and attributed to the increased need for management 
behavior on the part of teachers in activity-based class- 
rooms. Counter to expectations investigators using FIAC 
typically found that the ratio of indirect teacher techniques 
such as accepting student feelings, praise and asking ques- 
tions, to direct techniques, such as lecturing and giving 
directions, actually decreased in activity-based classrooms. 
This counter-intuitive finding, at least in part, can be 
explained by the increase in direction giving. In rough 
terms the findings suggest that an increase of ten percent 
in student activity results in an accompanying one third 
as much (3.6%) increase in direction giving. 

The direction of shift in level of teacher questions 
depends on the method used to determine amount of ques- 
tioning, that is, time devoted to or frequency of questions. 
If investigators used time as a measure — for example the 
number of three second intervals devoted to high and low 
level questions — a decreased percent (about 3%) of the 
time devoted to questions was spent on teacher high level 
questions in activity-based classrooms. However, if 
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observers counted the relative number of high and low 
level questions asked, there was about a sixteen per- 
cent increase in the number of questions which were 
classed as high level. These results suggest t$at high 
level^questions may take less time to ask than low level 
questions. Divergent question's, such as "why"?, "what 
is ^our opinion"? and "Do you have an idea on this"? may 
require less teacher time than questions which must be 
sufficiently detailed to insure student convergence on 

o 

the correct answer. The level of questions is important 
since other researchers have found that in elementary 
science classrooms higher level questions lead to higher 
level responses (Arnold, Atwocd and Rogers, 1973). 

In a related study by Porterfield (1969), transfer 
of questioning behavior, taught in SCIS training, to 
reading instruction was assessed. Second and fourth 1 
grade SCIS trained, reading teachers asked ten percent 
fewer recall questions and significantly more transla- 
tion, intepretation, analysis, synthesis and attitude 
or \*alue questions durina reading instruction. It might 
be the sliaht improvement in language development 

outcomes found in activity-based classrooms over non- 
activity-based classrooms, described earlier, is due in 
part to changed teaching behavior during reading lessons 
as well as the activity-based programs themselves. 
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The two expected shifts in classrocfrn practices, which 
failed to materialize, related to student talk. Of the^total 
observed talk there was no overall shift from teacher to 
student talk attributable to the use of activity-based 
programs, as one might have expected, and there was a 
slight decrease in total student talk which ,?as of a 
student initiated type (-2.7%). This last result was 
based on 13 comparisons in six studies. For only two 
of the thirteen comparisons which included student 
initiated and responsive talk was the shift in the expected 
direction. A profile of classroom time devoted to various 
practices as reported in the twelve studies is presented in 
Figure 10. It should be kept in mind that in the studies 
summarized here, observers, in generals, did not code talk 
among students or between students and the teachers during 
activities. Individual student initiated talk during 
small group activities surely would affect the average 
percentages of such talk reported for activity-based (4.9%) 
and for non-activity-based classroom (6.7%). 

In summary for the six shifts in classroom practices 
which were examined, four were at least in the expected 
direction, one marginally so, and two in the opposite 
direction, also marginally so. Figure 8 presents the 
expected and observed shifts for each category. 



Non r Activi fcber Activity- Numbgr 
Based of Based Q f 

- fo Time Groups % Time Groups 



Teacher and 


79.9 


5 


71 2 


in 

X u 


Student Talk 


(B.3)* 


(11.5) 




Teacher Talk 


54-2 


8 




X sJ 




(7.2) „ 




. (9-0) 




Teacher 


25.9 


7 

< 




12 
x c 


Instructive Talk 


(4.71 , 




(4.4) 




Student Talk 


25.6 


7 


21 9 


12 

X /L 




(3.3) 




(4.3) 




Taachar Confcpnt » 




u 


1 3 7 

X«J • f 


1 1 
X X 


Talk-Lecture 


- (4.3) 




(3.5) 




Stnripnt Rpqnnn-* 


18 6 


ft 


1 fi 7 

x u • 1 


1 1 

X X 


sive Talk 


(3.9) 




(2.3) 




1 DOUI lo 1 


1 7 R 


ft 
u 


1 7 ^ 


X x 


Questions 


(2.7) 




(3.3) 




Tparhpp 1 ni.i 


13 7 

X *J « f 




1 ^ 7 


~l 


Level Questions 






(3.0) 




Student 


9.9 


5 


19.4 


10 


Activity 


(3.9) 




(10.6) 




Student Init- 


6.7 


6 


4.9 . 


11 


iated Talk 


(4.0) 




(4.3) 




Teacher 


5.1 


6 


8.7 


11 


Directions 


(2.9) 




(3.5) 




Teacher High 


4.1 


"2 


2.2 


3 


Level Questions 






(3.1) 





Figure 10 Percentage of time devoted to various 
non-activityMbased classrooms. 

* Numbers. in parentheses are standard deviations. 
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